Integrate Automated QDQ placement tool - Part 3 #703

willg-nv · 2025-12-17T06:56:58Z

What does this PR do?

Type of change: new feature

Overview: This PR integrates automated QDQ placement tool to ModelOpt. This PR is 3/4 of the change. This PR contains the following changes:

Implements QDQAutotuner and Autotuner CLI interface
Implements Benchmark to measure E2E time of QDQ models.
unit tests for QDQ Autotuner and config.

Part 1: #701
Part 2: #702
Part 3: #703
Part 4: #704

Usage

python -m modelopt.onnx.quantization.autotune --model model.onnx

Testing

Implemented unit tests for QDQAutotuner and Config classes.

Before your PR is "Ready for review"

Make sure you read and follow Contributor guidelines and your commits are signed.
Is this change backward compatible?: Yes
Did you write any new necessary tests?: Yes
Did you add or update any necessary documentation?: No, document will be in part 4.
Did you update Changelog?: No. change log will be in part 4.

Additional Information

copy-pr-bot · 2025-12-17T06:57:01Z

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

willg-nv · 2025-12-22T03:24:50Z

@vishalpandya1990 could you help me review this PR? thanks!

vishalpandya1990 · 2025-12-22T06:34:13Z

@vishalpandya1990 could you help me review this PR? thanks!

Sorry for the delay. Added Ajinkya for review.

modelopt/onnx/quantization/autotune/__init__.py

modelopt/onnx/quantization/autotune/cli.py

gcunhase · 2026-01-08T20:54:25Z

tests/unit/onnx/quantization/autotune/test_autotuner.py

+from modelopt.onnx.quantization.autotune.common import PatternCache, RegionType
+
+
+def create_simple_conv_model():


Can we move this to tests/_test_utils/onnx/lib_test_models.py? Alternatively, NonSimplifiedModel or build_resnet_block could be used here instead?

@ajrasane WDYT?

Signed-off-by: Will Guo <[email protected]>

willg-nv requested a review from a team as a code owner December 17, 2025 06:56

willg-nv requested a review from vishalpandya1990 December 17, 2025 06:56

This was referenced Dec 17, 2025

Integrate Automated QDQ placement tool - Part 4 #704

Open

Integrate Automated QDQ placement tool - Part 2 #702

Open

Integrate Automated QDQ placement tool - Part 1 #701

Open

vishalpandya1990 requested a review from ajrasane December 22, 2025 06:31

willg-nv force-pushed the dev-willg-integrate-auto-qdq-placement-part3 branch from 3454bba to 4b9d789 Compare December 31, 2025 02:09